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PREFACE 



In 1991, the Massachusetts Job Council developed a survey instrument to ascertain basic 
information regarding funds spent on job training and to provide state policymakers with 
information about those being served and what services are being provided. The survey was 
distributed to administering agencies in four state secretariats. Responses were sought on four 
types of questions: funding levels, target groups, services and service providers. A summary 
of findings was presented to representatives of the four state secretariats in December 1991. 
There was no formal analysis of the data. 

The advaiiced state of coordination activity in Massachusetts warranted the Commission's 
use of that state as ? focus for this project. By using the Massachusetts experience as a 
laboratory experiment, the Commission developed a methodology for assessing program 
objectives, organizational structure, modes of service delivery, federal-state partnerships, and 
funding for employment and training programs at the state level. Specifically, this project 
develops a (1) sur\^ey methodology and computer program that can be used by states to assess 
and better coordinate their employment and training programs and (2) a code book that explains 
access to the computer program and statistical analysis of data contained in the tile. 

The survey contains two parts: (a) a program survey that would be administered to each 
head of a state's workforce development programs and (b) a substate area survey that would 
permit geographic analysis of the data and could be used as a mechanism for checking the 
accuracy of state-level information. Under this survey, states will be able to measure funding 
levels, origin, and methods of allocation; distribution of funds by type of service provider; type 
of services provided: population groups served; and geographic distnbution with sen'ice delivery 
areas. Any category or set of categories can be cross-referenced with other categories. 

This project is a natural extension of the investment that the Commission has made in 
finding ways to improve coordination of public assistance programs at the federal level. In 
addition to the work that supported our report. Coordinating Federal Assistance Programs for 
the Economically Disadvantaged: Recommendations and Background Materials , the Commission 
has sponsored research examining state- and local-level coordination techniques and strategic 
planning. This project is intended to carry the Commission's coordination message to the states 
by giving them a tool with which they can assess and better coordinate their employment and 
training programs. I would also add that the thrust of this report, strengthening the capability 
of the state to coordinate its job training programs, is consistent with our recommendations in 
the afore-mentioned coordination report and the recommendations that we will be offering in an 
upcoming Commission report on private industry councils and JTPA. 

John (\ (iartland 
Chairman 
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INTRODUCTION 

In Fiscal Year 1992, an estimated $320 million were spent on workforce development 
programs in the State of Massachusetts. These funds were administered through 31 separate 
employment and training programs involving a number of state departments and agencies under 
the direction of four Cabinet Secretariats. 

In an effort to provide policymakers with basic information on these workforce 
development prograins, the Mass Jobs Council (MJC) surveyed administering agencies to gain 
insights on four sets of issues pertaining to these programs: (1) funding levels, origins, and 
methods of allocation; (2) distribution of funds by type of service provider; (3) type of services 
provided, and (4) population groups served. 

Preliminary findings from the responses to the MJC survey were tabulated and reported 
by the Mass Jobs Council in six sets of tables. Since that time, the Mass Jobs Council has 
obtained additional information concerning funding as well as the number of people ser\'ed by 
engaging in telephone conversations with program directors in an attempt to com,.'.ete the sur\'ey 
responses. This report relies on the survey responses (the "MJC Sur\'ey Data Base") as the 
primary data source. We added the following information to that data base: the number of people 
served and their percentage distribution across programs (from a March 1992 Report of the Mass 
Jobs Council Restructuring Taskforce "Creating a World-Class Workforce Developmem System 
ill Massachusetts"). It is worth emphasizing that the total funding reported in the sur\'ey 
responses falls short of the amount indicated in the MJC Report by some $45 million. Since the 
information collected subsequently to the survey did not cover all the issues contained in the 
survey we have elected to base our analysis on the more comprehensive MJC Survey Data Base. 
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Building on the MJC's pioneering effort, the objective of this project is two-fold. First, 
to utilize the information gathered by the MJC in order to provide a relatively comprehensive 
account of workforce development programs operative in the State of Massachusetts. This effort 
is primarily intended to serve as an illustration of the kind of issues that may be addressed with 
the survey data. Second, drawing on lessons concerning what may be learned about sur\'ey 
design and data collection techniques from the MJC pilot project, to suggest a modified survey 
which attempts to address some of the problems encountered with the original effort. In addition 
it intends to elicit, by way of adding new questions, information that could noc be obtained with 
the old survey. 

In addition to the state-wide experience gained through agency responses to the 
questionnaires, we recognize the geographic dimensions to the collection of data on workforce 
development programs. Hence our sur\'ey is a two-part survey: a program survey which would 
be administered to the directors of each of the state's workforce development programs and a 
substate area survey. Adding a geographic dimension to the collection of workforce 
development program statistics would permit analysts to aggregate the data by both program and 
geographic area, thus enabling both statewide assessments as weP as comparisons of program 
coverage and performance by substate area. Such a data structure would allow for more 
informed evaluations of the fit between client needs and the distribution of program resources. 
Also, since similar information would be coilecled a: both the state and substate level, 
comparison of statewide program and aggregated substate responses would allow analysts to 
make some assessment as to the validity and reliability of the survey findings. 

This report is organized as follows: Part I gives an overview of the information contents 
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of the original MJC Survey and uses the tabulated survey responses to sketch a summary profile 
of the Massachusetts workforce development programs. This is followed in Part II by a brief 
discussion of the original survey's limitations and suggested modifications. In this part of the 
report, we also present the modified version of the MJC Sur\'ey. In designing the modified 
survey, we have addressed two questions: the reliability of the survey instrument and the need 
to develop survey administrative procedures that result in returns completed with data of the 
highest quality. The new survey design is general enough to be replicated anywhere in the 
United States and sufficiently specific to cover all facets of workforce development programs. 
To enhance compliance, a detailed instruction sheet as to how the survey questionnaires should 
be completed is made an integral part of the sur\'ey instrument. Part III provides step-by-step 
instructions for creating a computerized survey data base to be used in conjunction with the 
survey questionnaires. 
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I- MASSACHUSETTS WORKFORCE DEVELOPMENT PROGRAMS: 
AN OVERVIEW 



1. THE INFORIVIATION CONTENT OF THE MASS JOBS COUNCIL SURVEY 

The survey instrument developed by the Mass Jobs Council was designed to collect data 
on Massachusetts workforce development programs from administering State agencies in four 
Cabinet Secretariats. The MJC survey questionnaire consists of four sections, each dealing with 
a specific set of issues. Section I of the survey addresses funding levels, sources, and methods 
of funding allocation. Section II is devoted to target groups: demographic and other socio- 
economic characteristics of population groups served. Section III solicits information on the 
types of services provided. Methods of funding distribution by type of service providers are 
covered in Section IV of the questionnaire. In addition to quantitative information, qualitative 
questions were asked to collect some descriptive information about specific aspects of the 
workforce development programs. The most frequent type of qualitative question asked is: 
"What factors influence your program decisions about target groups?"; "What factors influence 
your program decisions about service mix?"; "What factors affect your program decisions about 
service providers?" and so on. This report does not report on these qualitative questions. 

In Table 1, we present a match up of questions and agency responses tabulated in six sets 
of tables which are reproduced in the Appendix to this report (Table Sets A through F). Agency 
responses to questions pertaining to program funds and funding sources in the first part of the 
survey (Sections LA through I.D) are tabulated in Table Set A. Agency responses to questions 
relating to methods of funding distribution (Sections I.E through LG of the survey) are reported 



in Table Set B. Agency responses to questions about funding distribution by major service 
providers in Section IV of the survey are tabulated in Table Set C, and information concerning 
the major types of services provided (Section III. A of the survey) is given in Table Set D. 
Section III.B of the survey seeks information on the provision of specific services. Since this 
section u'as not completed by the majority of agencies no tabulation of responses was possible. 
Finally, Table Sets E and F contain tabulations of agency responses to questions asked in 
Sections II. A and II. B of the sur\'eY dealing with people served and their characteristics. 



TABLE 1 : .MATCHING MJC SURVEY QUESTIONNAIRES WITH 

TABULATED RESULTS 



Table Set 


Topic 


Survey Questions 


A 


Funding Sources 


LA to LD 


B 


Methods of Funding Distribution 


I.E to I.G 


C 


Major Service Providers 


IV 


D 


Types of Services Provided 


III. A 


E 


People Served 


U.A 


F 


Characteristics of People Served 


II.B 



Note: Qualitative questions contained in the survey do not foim part of 
these tables. 



Survey responses were retunied (m varying degrees of completeness) for a total of 31 
workforce development programs. Table 2 lists the workforce development programs as they 
appear in the sur\'ey responses/ 



TABLE-2 
MJC SURVEY DATABASE 
MASSACHUSETTS WORKFORCE DEVELOPMENT 

PROGRAMS 



PROGRAM 



SECRETARY OF ECONOMIC AFFAIRS 

Job Training Partnership Act (J 1 PA IIA) 

Job Training Partnership Act (JTPA II B) 

Kmpio} nicnt Service 

Disabled V\'terans Outreach Program (DVOP) 

Local Veterans Kniploynient l^cpresentatives (LVKRS) 

HaySiate Skills: 50/50 

HayState Skills: Global Kdaeation 

HayState Skillx: Displaced Ilomeniakers 

Mass jobs Southeast 

Jobs Corps 

Targeted Jobs l ax Credit (VyVC) 



SECRETARY OF EDUCATION 
School-to-Work Transition 
Chapter IHH (Dropout Prevention Only) 
Adult Mdueation 

State Legalization hnpaet Assistance Act 
Perkins Voca tional Kducation Act 

McKinney Homeless Act 

National Workplace Literacy 



SECRETARY OF HEALTH AND HUMAN SERVICES 

Targeted Assistance: Allocation 

Targeted Assistance: Discretionary 

Refugee Kducation and Kmployment 

JOHS 

N'eterans Job 'Training (.TTPA l\'C) 

Labor Shortage lnitiati>e Trust Fund 

MRC N'ocational Rehabilitation 

MRC Lxtended LmploynuMit 

MRC Supported Kniplo\ment 

MCB Vocational Rehabilitation 

DMIl Kmployment <S: J'raining 

DMR Kmployment iS: Training 



SECRETARY OF LABOR 



{Industrial Services Pi-ogram (J TPA ILL) 
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In the following sections, we highlight some of the key findings obtained from the suivey 
responses. This discussion is based on the tabulations of responses presented in Table Sets A to 
F in the Appendix. Although sur\'ey questionnaires were filled out for 31 workforce development 
programs, complete responses were given for only a small subset of programs. As the survey 
attempted to gather more detailed information on the methods of funding allocation, service 
providers, types of services offered, and the socio-economic characteristics of the individuals 
served, the subset of programs for which these data were made available by the responding 
agencies and thus the total funds accounted for were reduced further. These limitations have 
somewhat constrained the subsequent analysis of the MJC Survey Data Base. Therefore, the 
subsequent analysis should be regarded more as an illustration of the kind of issues and questions 
that can be addressed with the survey. 

2. FUNDING 

Sources and Distribution 

Workforce development programs receive their funds from three primary sources: the 
federal government, the state government, and other sources. 

In FY 92 close to $320 million were spent on workforce development programs in the 
State of Massachusetts. Of these, approximately 54 percent originated from the federal 
government, 35 percent were contributed by the State, and the remainder was secured from 
"other" sources, most notauly in form of federal tax credits made available directly to 
participating employers through the Targeted Jobs Tax Credit measure (TJTC). Table 3 
illustrates this point further by grouping the programs according to their funding source: federal. 



I AHLK 3: KMPLOYMENT AND TRAINING PROGRAMS 
SOURCE OF FUNDS, FY 1992 







r UiNUirsO 
in > 
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I O 1 AL, 




A: FEDERALLY I VSDED (100%) 






I 


Job Traiiiinj; rarliicrship Act (JTI'A IIA) 


S3l.9S2,000 


3S.6Cr 


2 


l\in{>li»ynieiil Services (KS) 


$18,536,000 


22A7t 


3 


\iih 1 rainin^i Pjirtncrsiiip Act (J'lTA WW) 


SI2.3S3.000 


I5.0S? 


4 


Jo!) ('orps {l ed. Admin. l*roj>ram) 


$12,152,000 


14.77? 


5 


Wicraiis Outreach l*roj>ram (DVOP) 


$1,965,000 


2.49? 




Iit*fii<it*c I'xlui'ation and Kniploynienl 
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Id 
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A 

U.J /C 


1 1 
1 I 


MfKinncN Ilonicless Assistance Act 


C n< AAA 


0.57c 


1 - 


National Workplace Literacy 


S3v 1 .000 


0.57J 
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1 ' ir.i\ iiiU U) Juo to rtninchng 

• t )! ;!i:s ;i!n(nir.t. S7S,0()() lire attributed iti sources. 
■ ■ !.'. ';!.\ N i:v.- S^N.noo al!(K'ated Vet eran.s Job Training: (JTPA W-C) 



state, and joint federal-state funding. It should be noted that 13 programs (excluding TJTC) were 
financed solely through the federal government; 9 received exclusively state funds while the 
federal and the state governments contributed jointly to 6 programs. Two programs: (TJTC and 
Labor Shortage Initiative Trust) obtained funding from "other" sources. No funding information 
was provided for the Adult Education program. 

The allocation of program funds across State Secretariats was as follows; 54.6 percent 
of the $320 million supported programs under the administration of the Secretary of Health and 
Human Services; 6.4 percent of the funds were administered by the Education Department, and 
5.5 percent by the Labor Department. Approximately one third (33.4 percent) of the program 
funds were under the purview of the Secretary of Economic Affairs. This figure, however, 
included approximately $39 million in funds that we:e not truly controlled by the State (TJTC 
funds which are administered by the Internal Revenue Service and JobsCorps funds which are 
under the control of the U.S. Department of Labor). The State thus had some administrative 
control over $281 r.;illion or 87.8 percent of the total although some $56.7 million were subject 
to allocation formulas. Of note is the fact that the four Cabinet Secretariats differed in terms of 
their primary source of funding: while programs under the authority of Economic Affairs were 
primarily federally funded, the others relied relatively more heavily on state sources. 

Within the workforce development system funds may be distributed via a variety of 
different methods: allocation formula, request for proposals (RFP), direct grants, retained by 
agency, and "other" (the latter includes special set-asides for incentive awards and interagency 
service agreements). Information on the distribution methods was obtained from the MJC Survey 
for 25 out of 31 programs, accounting for some $265 million or 82.8 percent of total funding.^ 
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As shown in Figure 1, of the $265 million, 30.8 percent was distributed through competitive 
bidding at the agency level (RFP), 22.7 percent were retained by the administrative agencies 
either to cover stale administrative costs or for direct services, 21.4 percent were allocated by 
formula, end 24.4 percent were distributed via "other" methods. This other category included 
some $62 million which the JOBS program set aside to fund interagency service agreements and 
$1.9 million or 6 percent of JTPA IIA money which was set aside for incentive awards to SDAs 
exceeding performance standards and technical assistance grants to outside organizations. 
Finally, 0.7 percent of the total funds wefe disbursed in form of direct grants for three 
programs: the Bay State Skills:Global Education, the Targeted Refugee Assistance 
(Discretionary), and the Industrial Services (ISP - JTPA III) programs. 

Although the $320 million in program funds supported a mixed basket of 31 workforce 
development programs in the State of Massachusetts a significant portion of these funds was 
consumed by just a handful of programs. The top five programs (excluding TJTC) accounted 
for some $197 million or 67.2 percent of the $293 million in combined federal plus state 
funding. They were: JOBS (25.7 percent of total funds), the Vocational Rehabilitation program 
offered by the Massachusetts Rehabilitation Commission (MRC; 14. 1 percent), JTPA IIA (10.9 
percent, the Department of Mental Retardation programs (DMR; 10.2 percent), and Employment 
Services (6.3 percent). 

Service Providers 

Among the ultimate service providers that administer work force development programs 
one can distinguish betv;een four well-defined groups: direct state service, community-based 
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organizations (CBO), educational institutions^ and Service Delivery Areas (SDA)/ A fifth 
category "other" includes such diverse providers as employers offering on-the-job-training, state 
universities, correctional institutions, and municipalities. 

The MJC Survey responses provided information on the funding of service providers in 
20 programs receiving a total of $173.6 million as detailed in Table 4.^ Of these, some 61 
percent were received by CBOs which, therefore, constituted the primary service providers 
within the Massachusetts workforce development system. Educational institutions received 19.4 
percent of the funds while State agencies and the SDAs as direct service providers accounted for 
2.3 and 4.1 percent of the funds respectively. A rather substantial portion of the funding (13 
percent) was received by the "other" providers (see Figure 1). 

Senice Types 

Workforce development programs provide a number of services which may be grouped 
into four broad categories: basic skills, occupational training, job placement, and supportive 
sei-vices (i.e. child care, transportation etc.). 

Information on funding allocation by service wpe across programs is given in Table 5, 
We note from agency responses that supportive services were the frontrunner, absorbing $57.6 
million or 40 percent of the $142.6 million in total program funds accounted for here. 
Occupational training ranked second with 33 percent of total funds. Job placement services 
accounted for 14.4 percent. 
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3. PEOPLE SERVED 

Distribution Across Workforce Development Programs 

In FY 92, Massachusetts workforce development programs served an estimated 422,000 
people.^ This figure should be viewed as a rough approximation of the actual number of 
enrollees for two reasons: data were not available for a few programs (Chapter 188 Dropout 
Prevention and Department of Mental Health (DMH) programs) and secondly, the reported 
number of individuals served is said to include double counting. 

As the data in Table 6 show, workforce development programs administered by the 
Secretary of Economic Affairs dominated the scene in terms of the number of people served 
(281,469 or 66.6 percent of the tota.). This is attributable in large part to the coverage of a 
single service program: some 232,000 individuals reportedly received job placement services 
through the Employ m.ent Services (ES) program. The fact that 55 percent of all people for whom 
data were reported were enrolled in one single program clearly distorts any comparison one may 
wish to make across cabinet secretariats on a program -by-program basis. To illustrate this point, 
the third column in Table 6 recalculates the percentage distribution of enrollees across 
secretariats after removing from the total those people served by the ES program. <^nce ES is 
excluded, the Economic Affairs Secretariat loses its top ranking with 26 percent of all enrollees. 
It falls back to the third position behind Education (35,4 percent) and Health and Human 
Services (32.3 percent). In terms of individual programs across all four secretariats, the 
elimination of ES leaves MRC at the top of the list with 21.4 percent of system enrollees, 
followed by the Perkins Vocational Education Act program (17.6 percent) and JOBS (19.5 
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percent). Together these top three programs accounted for close to 60 percent of all service 
recipients, underscoring the fact that - despite the exclusion of the ES program - the 
distribution of participants in the Massachusetts workforce development programs is skewed 
towards a very few programs. 

Participant Profile 

To determine a profile of the typical service recipient in terms of demographic and socio- 
economic characteristics requires information on both the total number of participants as well 
as their percentage distribution in terms of demographic and socio-economic characteristics on 
a program by program basis. The number of programs reporting in the sur\'ey on the socio- 
economic characteristics of their enrollees varies depending on the variable in question. The key 
variables are: age (youth, age 14 to 21; and older workers, age 55 and older), gender (male 
only), race (minorities only), disabled, and low income status. Table 7 reports the percentage 
distribution of people served by selected characteristics for the subsets of programs for which 
the pertinent information was available. The smallest subset comprises those 6 programs that 
provided complete information on all 6 variables reported on in Table 7. Focussing only on 
gender and age composition (youth and older workers), enrollee distribution by these 
characteristics is known for eleven programs. Information on low income status was given for 
only eight of the 15 programs listed in Table 7. 

Based on the profile of enrollees sketched in Table 7 and Figure 2, 14.6 percent of those 
served by the Massachusetts workforce development system in FY 92 were youth between the 
ages of 14 and 21; 8.5 percent were older workers; the remaining 76.4 percent -vere adults 
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between the ages of 22 and 54. The gender breakdown of euroUees was 57 percent male and 43 
percent female. Minorities appear to have been "over-represented" relative to the state average 
as minority enroUees accounted for 23.9 percent of the total. This over-representation of 
minorities most likely reflects the fact that the focus of the majority of programs is on the 
economically disadvantaged a population segment in which minority representation by far 
exceeds that in the general populat'on. For instance, in 1990, 6.8 percent of the white population 
in Massachusetts lived in poverty compared to 21.7 percent of the black population. The data 
given for the 15 programs in Table 7 underscore the fact that approximately one third of 
program enrol lees fell in the low income status category. Of interest is also the fact that 4.5 
percent of those people served were persons with disabilities. 

Program priorities may be deduced from data enabling comparisons across programs. It 
is inferred, for example, that young people enjoyed a greater than average representation in 
programs such as JTPA IIA, JobsCorps and JTPA IIB (with the latter specifically targeting 
young people), while Disabled Veterans Outreach Programs (DVOP), Local Veterans 
Employment Representatives (LVERS), and to a lesser extent - Industrial Service Program 
(ISP) served a relatively high proportion of the older population with 19.9, 18.3 and 13 percent 
of all enrollees respectively belonging to this category. Minorities were significantly over- 
represented in the JTPA IIB (50.6 percent). State Legalization Impact Assistance (95 percent), 
McKinney Homeless Assistance Act (70 percent). National Workplace Literacy (44 percent) and 
JOBS (46 percent) programs, while women constituted the overwhelming majority of enrollees 
in the McKinney Homeless Assistance Act and the JOBS programs with 70 and 95 percent 
respectively. 
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Distnbution Across Services 

Many workforce development programs offer a mix of services (Basic Skills, Training, 
etc.) although some programs offer only one type of service. Enrollees often receive more than 
one service when participating in a given program, thus program "output" may be more 
appropriately measured in terms of "ser\'ice units" rather than number of people enrolled. Table 
8 uses this approach and describes programs in terms of service units delivered by service type. 
As shown in the table, complete information on the number of program enrollees and the types 
of services that they received was available for a total of 12 programs in the MJC survey.'' 
These 12 programs enrolled 95,949 individuals and delivered a total of 121,831 service units in 
FY 92 (about one-fourth of all participants in the Massachusetts workforce development system). 
The relative importance of the different services is depicted in Figure 3. The provision of 
supportive services appears to have been the first and foremost function performed by the 
Massachusetts workforce development system (close to 47,000 or 38.4 percent of enrollees 
received this service.) Next in line was job training, accounting for close to 29 percent of all 
service units, followed by job placement with 24 percent. Even though a direct comparison 
between data reported in Tables 5 and 8 may not be warranted (given the different subsamples 
of programs), it is nonetheless worth noting that job placement services accounted for close to 
one fourth of all service units while claiming a much smaller fraction (14.4 percent) of the 
system's finances. This fact can undoubtedly be attributed to this service's limited resource 
needs. Basic skills accounted for 8,9 percent of all service units but received 12.3 percent of the 
financial resources. 
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4. SERVICE COST 

It is possible to assess the unit cost of services provided by a state workforce 
development system wit'i sufficiently disaggregated data. Table 9 illustrates this exercise for a 
subsample of the programs listed in Tables 5 and 8. The subsample consists of those programs 
for which the MJC Survey successfully elicited information on the distribution of funds as well 
as the distribution of enrollees across the various services. Data on both sets of Vdriables were 
available for only 7 programs: Massjobs Southeast, Slate Legalization Impact Assistance, Perkins 
Vocational Education Act, McKinney Homeless Assistance Act, JOBS, National Workplace 
Literacy, and MCB Vocational Rehabilitation. 



TAKLE 9: AVERAGE COST PER SERVICE UNIT 



Service Type 


Funding $ 


Service Units 


Average Cost 
per Unit $ 


Basic Skills 


8,236,139 


6,120 


1,346 


Training 


25,459,884 


22,211 


1,146 


Job Placement 


9,824,117 


12,510 


785 


Supportive Serv. 


54,423,158 


29,189 


1,865 



The findings reported in Table 9, which are based on the seven programs noted above, 
are presented here for illustrative purposes. The data suggest that within the Massachusetts 
workforce development system the provision of supportive serx'ices was the most costly function 
with an average cost per unit across programs of $1,865. Job placement ser\'ices were the least 
costly aver.iging about $785 to place an enrollee in the job market. 
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A belter assessment of the unit cost of services might be attained by disaggregating the 
data by program, service, and geographic area. However, program services differ not only in 
terms of characteristics of population ser\'ed, but also in the method of provision and -- most 
importantly - in terms of program and service content. A category label such as "basic skills", 
"training", c 'supportive services" is sufficiently broad so as to encompass a multitude of 
s-.^.rvices, which are likely to differ from program to program. But, perhaps most important to 
service unit cos: Is tht degree to which the cost is driven by the characteristics or the profile of 
a program'f> enroUees and hence the type of service provided. As the MJC sur\'ey coverage did 
not elicit mtormation on either the profile of enrollees by type of serx'ice or on the distribution 
of said c .rollees among service providers, a ineaningful comparison of service costs across 
programs is not feasible. 
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II. WORKFORCE DEVELOPMENT PROGRAM SURVEY 



1. SURVEY DESIGN 

While the MJC siir\'ey was an important first step in gathering information on the 
distribution of program funds, the preceding discussion clearly underscores the importance of 
survey design and sur\'ey administration for securing reliable and complete responses to survey 
questions. To provide policymakers with information that will allow them to make informed 
judgements about workforce development programs within their jurisdictions, a new surv-ey was 
developed, henceforth referred to as the Workforce Development Program Survey. 

One important question that had to be addressed in designing the sur\'cy is the sampling 
frame. That is, should the sampling frame consist of cabinet secretariats, stale agencies that 
administer workforce development programs, programs, service providers, etc.? The MJC 
survey utilized programs as the unit of analysis. The new survey retains this feature but adds 
another dimension to the collection of data in a manner that would allow analysts to examine 
various program characteristics by aggregating results for administering agencies and by 
geography. Administering agency is an important dimension because authority and responsibility 
for program change is likely to reside with agency officials. Geography is an important 
dimension because labor market conditions are likely to vary significantly within the state, 
especially between urban and rural areas. 

As an illustration: results from the MJC data reflect the statewide experience. What could 
not be ascertained, hov/cvcr, is how program choices regarding service and client mix vary by 
type of subslaic area. Thus, assessments of whether workforce development programs have been 
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delivered in a fashion that addresses the most pressing needs of clients in particular substate 
areas were not possible given the survey structure. While many survey respondents reported that 
their scp/ice/client mix matched the needs of their area, the survey did not provide an 
independent means for verifying these statements. For instance, it was not possible to compare 
indicators obtained from other sources at the substate level, such as unemployment rates and 
labor force composition, with the outputs of the state's 31 workforce development programs. 
This shortcoming is addressed in the new survey. 

The Workforce Development Program Survey adds a geographic dimension to the 
collection of workforce development program data. This component requires the identification 
of geographic reporting areas that would be identical for all of the state's workforce development 
programs. One possibility is the Service Delivery Areas utilized by programs funded under the 
Job Training Partnership Act. It is a good starting point which could be modified to fit the 
particular needs of programs in different states. 

In addition to the program survey, the survey instrument would be administered by 
geographic area (e.g., SDAs) to collect information for each area by program. This added 
coverage would make it possible to aggregate the data by both program and geographic area, 
enabling both statewide assessments as well as comparison of program performance by substate 
areas. The new survey structure would allow for more informed assessments of the fit between 
client needs and the distribution of program resources. SDA responses together with agency 
responses to the program survey would permit analysts to check the validity and reliability of 
the survey. Programs where discrepancies between the two sets of figures are quite large would 
warrant further investigation to identify the source of error. More importantly, information on 
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the geographic distribution of workforce development programs would prove to be invaluable 
to policymakers interested in developing a more comprehensive and coordinated structure to 
workforce development system. The Workforce Development Program Sur\'ey presented in this 
report thus consists of two parts: the program survey and the SDA survey. 

2. PROGRAM SURVEY 

The program survey would be administered to the directors of each of the state's 
workforce development programs. The questionnaire would collect statewide information on 
workforce development programs including funding levels and distribution, service providers, 
services, and clients. The new survey instrument is modeled along the topical areas covered in 
the original MJC sur\'ey, and where needed modifications were introduced. The program survey 
questionnaire, including instructions for completion, is presented at the end of this section. 

The most striking difference between the new survey and the original MJC survey is our 
emphasis on collecting information on the number of clients ser^^ed. The original MJC survey 
instrument only asked for percentages of various client groups ser\'ed. As a result, comparative 
analyses across programs and analyses of all programs were weakened because total numbers 
of clients served were not reported. 

We have also made changes to the survey instrument to lessen the reporting burden of 
respondents. For example, information on services provided have been collapsed into one table 
and grouped by type of service (e.g. job search assistance, basic skills, occupational training, 
support scA'iccs). 
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3. SERVICE DELIVERY AREA SURVEY 

In addition to the program survey, to be completed by state program officials, we propose 
the administration of a second set of surveys, to be completed by each of the state's SDA 
directors. Each SDA director would complete one survey for each workforce development 
program operating within his/her Service Delivery Area. The SDA survey instrument would 
collect the following information on workforce development programs: funding levels and 
distribution, service providers, services, clients, and geographic distribution of applicants, 
clients, and program dollars by type of geographic areas within the SDA (e.g., central city, 

suburban city, rural community). The SDA survey questionnaire is also presented at the end of 

this section. 

The SDA survey questionnaire would elicit information not gathered by the statewide 
program survey. Data would be available to assess questions pertinent to variation across SDAs 
in the mix of service providers, ser\'ices, clients ser\'ed, the type of area assisted (city, suburban, 
rural), and so on. Answers to these questions would allow policymakers to look more closely 
at the distribution of program funds and evaluate the extent to which funding distributions 
correspond with the incidence of need in their states. 

4. SURVEY ADMINISTRATION 

Administration is the key to success. As the single most important element to improving 
the quality of the workforce development program survey data, we propose that prior to 
submitting the survey questions to appropriate officers, whoever is in charge of administering 
the survey schedule one or more workshops in which analysts and would-be respondents have 
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a chance to interact and discuss the sur\'ey. At such a session, the design of the sur\'ey 
instrument could be discussed and respondent ambiguity regarding particular questions could be 
addressed. In addition, the workshop could be used to stress the importance of the survey data 
and to communicate to respondents the need for complete returns. Our field work conducted as 
part of this project found that in many instances respondents did not complete the MJC 
questionnaire because they perceived it to be one of dozens of surveys they had been asked to 
complete. It is to be emphasized that data quality will only improve when policymakers and 
program administrators communicate to program managers the importance of promptly and 
accurately completing the workforce developmen* ogram survey. 

5. SAMPLE QUESTIONNAIRES 

In the following, we present a set of sample questionnaires for the program and SDA 
surveys. 



WORKFORCE DEVELOPMENT PROGRAM SURVEY 
Instructions for Completing Program Questionnaire 
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NOTE: Please answer all questions. Do not leave responses blank. Enter an em dash 
(_) if response is not applicable. Enter NA if data is not available. 



1. Name of Program. Enter tho name of the program 

2. Administering Agency. Fnier the namo of the state agencv responsible for program 
administration. 

3. Contact Person. Enter the name and phone number of the person who can best answer 
follow-up questions re^jardinG: the completion of this questionnaire 

4. Fiscal Year Reported. Enter the fiscal year for which vou have complete data and i)asp 
your responses on this year. Enter the bei^innin^ and endins dates for the fiscal year reported 
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Part I. FUNDING LEVELS AND DISTPvIBLTION 

Thi< portion of the ^un-nv Uk'u-p. l.n^.dinir h-^oh ;ind the dh^-tribution nf t\ind> to recipients at 
ih(^ --ubsiate Icvfd 

A. Program Funds, Ent^-r ilu- i. (ai aw.'WV t fuivw a\ aiiabl.- f^r i!n> jT'-raai in h.-cal IfO _ 

B. Funding Sources. Enter the amount of I'.rriiram funds donsi^d fn.m tVdcrai. >iate and 
l(Kal iiovc^rnments as woW as program lunds (.btampti trnm othrr -^nurcc- Eor state tunds, please 
indicate the Mate budizet line item undt r 'Ahich pn-.irram fund> APrc i>rnvidcd 

C. Direct Services. Indicate how much of the proirram s fiscal 109_ fundinir was retained by 
the state administering at^ency to provide direc[ services. By (hrert ^er\'ices, we mean instances 
where the proirram's administenncr atzency provides sen-icos to clients, such as the operation of a 
skills center. 

D. Non-Direct Services. Indicate how much of the proirram's fiscal rJ9_ fundinc: v as 
retained by the state administerins: airency for non-direct service purposes, such as e-neral 
administration, technical ass tance. monitoring and oversight, etc, 

E. Funding Distributions. Of the balance of fiscal 199_ funds not included in Items D and 
e[ how much was allocated to recipients by allocation formula, by ccmpetinve requests for 
proposals, bv non-competitive grants, or by some other allocation method Sole: the amount 
reported in item A should equal the mm of the amoi nt-s reported in items C. D. and E. 

F-H. Formula Allocation. If this proirram u^es an alhvation formula to distribute some or all 
of us funds to the substato level. plea>e provide addMional information on the structure of the 
formula and its distributional impacts 
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I. RFPs. Describe the RFP process used to distribute funds under this program. 3 2 

J. Non-Competitive Grants. Describe how non-competitive grants are used to distribute 
funds under this program. 

Funding Notification. Indicate approximately what time of year your agency receives 
notification of the amount of program funds that wiU be available for the upcoming fiscal year, 

L. Direct Recipients. Indicate the amount of program funds awarded to various types of 
direct recipients and note how much cf these funds were awarded by formula, by RFP. and by 
non-competitive grant. Include only those recipient organizations that the administering agency 
directly funds through this program. Those oro:anizaiions may or may not be the agencies 
responsible for service provision. Xote: Vie total amount of funds reported in thus table should 
equal the total amount of fund.^ reported in Item l-E. 

Part II. SERVICE PROVIDERS 

A. Service Provider Organizations. This section of the sur\-ey asks for information on the 
types of sor\'ice providors utihzpd under this pros^ram Indicate the total amount of funds 
awarded to each of the lypos (if >orvico providers hsted m the table. In addition, please indicate 
whether (ir not the use of earh lype of >er\'ice provider is required by federal ancLor state statute. 

B. Ser\'ice Provider Mix. Bru'lly do^crihe what fact{)rs other than fedornl andor <tare law- 
influence the mix of >('r\ ire provider^ unlized under \\\\> pro<:ram 

Part III. SERVICES 

.\. Type of Services, '/lu^ -.n-iiun nf :ht» ^uiAf.\ .i^i<^ fo^ m format ion on tho ryi^es of s«'r\'u*fs 
i^rovided throuixh thi< pr-jram Fnr (\n^h tyi-»' nf .^rA-irp indicatoihc totaLunount of[)roi;ram 
Uinds and the numhor >nrA-od includmii '-^juhle v'ruinis " In adriiiion. iav t\ich >er\ ice 

provided. plea>e indiratr uhcihrr f«Ml(Tal and nr -taie law require a minimum k^vel of eff(»rt and 
if -o noir ihe nunimum V^^iuired scpw ice level P.e -ure to indicate whother ihe minimum -en icp 
throhold apph(N to the t^ropoi iion of funds or to the [in)[)ori ion o{ rli(»nt> >orA'r^<i 

B. Service Mix. Mrietly describe what factors other than federal and. or stato law mtluence the 
mux of >er\*ices provided under this program. 



Part IV. CH.ARACTERISTICS OF CLIENTS SER\^D 

This section of the sur\'ey f(x:uses on the characteristics of clients served under this program 

A. Applicants. Enter the number of ap[)Iicanis for sen'ices under this program for fiscal 
1^^^') Include all indi\ i(luals who apf)lied for assistance under this program 

B. Clients Served. Knter the total number of clients ser\'ed m fiscal 199 In addition. 

please list the number of clients that completed the program, the number of clients that dropped 
out of the protrram [)n(^r to completion, and the number <>f clients that were ser\-ed by more than 
one proixram over the course of the fiscal vear 
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C. Client Characteristics. Report the number and percentage of clients served in fiscal 199_ 
according to the demographic categories Usted m the table. Include "double counts" in your 
calculations. In addition, please indicate whether or not federal and/or state law require a 
minimum level of effort regarding certam demographic groups. .\nd if so, please be sure to 
indicate whether the minimum level of effort appUes to the proportion of funds or to the 
proportion of cUents served. 

D. Client Mix. Briefly describe what factors other than federal and;br state law influence the 
t\-pe of clients served under this program. 

E Target Groups. Report the number and percentage of clients sen-ed in fiscal 199_ 
according to the target groups listed m the table. Include "double counts" in your calculations. 
In addition, please indicate whether or not federal and'or state law require a minimum level of 
effort regarding certam target groups. .\nd if so. please be sure to indicate whether the 
minimum level of effort appUes to the proportion of funds or to the proportion of cUents seI^•ed. 

F. Target Group Mix. Brietly describe what factors other than federal andbr state law 
influence the client groups targeted for ser\-ices under this program. 
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WORKFORCE DEVELOPMENT PROGRAM SURVEY ^ ^ 



1. Name of Program: 

2. Administering Agency: 

3. Contact Person: Phone: 

4. Fiscal Year Reported: ^ Dates for Fiscal Year: From: To: 



I, FUNDING LEVELS AND DISTRIBUTION 

A What is the total amount of funding available to your program in fiscal year 1 99 ? 

B. How much of the funds available to your program in fiscal 199 were from the following sources: 

1. Federal $ 

2- State _S State budget line item number: 

3. Local $ 

4- Other $ (please specify source) 

C How much of your fiscal 199_ funding was retained by the state-level administering agency to provide 
direct services (for example, occupational training, skills assessment, support services, counseling, etc.)? 

Please describe services provided: 



How much of your fiscal 199_ funding was retained at the state level for non-direct service purposes, 
such as technical assistance, momtonng and oversight general administration, etc ? 

Please describe activities- 



E. Of the balance of funds that are not accounted for in questions "C" and "D'^ above, how much of your 
funding was allocated through the following mechanisms in fiscal 199_'^ 

_S _1. Allocation fomiula 

S 2. Competitive Request for Proposals (RFPs) 

_S ^3 Non-competitive grants 

S 4. Other (please specify) 



NOTE: Amount reported in Item A should equal the sum of amounts reported in Items C, D, <S E. 
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I FUNDING, CONTD 

F If your program used an allocation formula to distribute some or all of your funds to the substate 
level, please indicate how this process works. (Check appropriate response below). 

1 . Prescribed by federal law/regulation 

2. Prescribed by state law/regulation 

3. Developed at agency discretion 

4. Other (please specify) 

Please list formula factors and weights, and briefly describe their effects (e.g., favors rural areas) 



G If your program used an allocation formula to distnbute some or all of your funds to the substate level, 

does your agency have any discretion regarding which formula factors were used to determine grant awards? 

No Yes 



H. If your program used an allocation formula to distnbute some or all of your funds to the substate level, 
does your agency have any discretion regarding the relative weight assigned to each formula factor? 

No Yes 



if your program used a competitive request for proposals (RFP) process to distnbute some or ail of 
your funds to the substate level, please descnbe the cntena used to select funding recipients. 



J If your program distnbuted some or all of your funds to the substate level via some fonm of 
non-competitive discretionan/ grant, please descnbe the cntena used to determine how those 
funds were awarded. . 



K What time of year does your program typically receive notification of funding levels for the upcoming year^ 
1 . JAN - MAR 2. APR - JUN 3. JUL - SEP 4 OCT - DEC 



L How much of your program's substate funding allocation was awarded in fiscal 199 to each of the 

following types of direct recipients. Note that direct recipients may not necessanly be the ultimate 
service provider. For example, municipal governments may be the direct recipients of program 
funds, but they could then use them to fund community based organizations to provide services. 





Amount Distributed by 


Type of Direct Reaptent 


Total Dollars 


Formula 


RFP 


Grant 


Regional Employment Boards (SDA) 


I 








Municipal govemments 










Local school systems 










Higher education institutions 










Community based organizations 










Other (please specify) 
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II. SERVICE PROVIDERS 
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A. What types of organizations were the service providers for your program in fiscal 199 ? 



v^umpiGiG do mafiy r&sponsGS aS QiQ dppiiCdDiQ 


/ Do//ar 
Amount Awarded 


Is Use of 77?/s 
Provider Required by 
Federal/State Statute 


1 yps7 Uf Ot7fWOC7 rfUVtUy^f 


Yes" 


No 


Oldie Agency— uireci otste bervice Provision 








ouM oKiii Ocntor 








ut 1 upponunity Job Center 








Elementary and Secondary Schools 








Vocational School 








Proprietary School (Non-Degree Granting) 








Community College 








Two- Year Private College 








English-as-Second Language Leammg Centers 








Community-Based Organizations 








Other folease soeclfv^ 









































































* Enter "F" jf a federal requirement; "S" if a state requirement. 



B What factors other than state or federal law influence your mix of service providers'^ 
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III. SERVICES 



A. What general types of senyices were provided under this program? 



Cruvplete as many items as 
applicable for your program 


Amount of 
Program 
Funds 


Number of 
Clients 


Does the Law Specify £ 
Level of Effort for This 
What Level is Req 


f Minfrnurn 
\^erviGe f 
uired? 


Type of Service 


Servecm 


Yes' I 


.evel-(%) 


Mn 


Job Search Assistance 












Job Search 












Job Placement 












Other (please specify) 




































Basic Skills 












GED 












English as Second Language 












Literacy Training 












Adult Basic Education 












Other (please specify) 




































Occupational Training 












Classroom Training 












On-the-job Training 












Quality/productivity training 












Other (please specify) 




























1 






Support Services 




» 

j 






Day Care 




1 






Transportation 




1 






Supported Work 




\ 






Other (please soecify) 




1 






























Subsidized Employment 












Supported Work 












Summer Jobs for Youth 












Other (please specify) 




































Administration## 













# Include double counts. 

* Enter "F" If a federal requirement: "S" if a state requirement. 

Indicate whether this requirement applies to the proportion of people receiving the service, or to the proportion 
of funds spent on It. For example, to indicate a 10% set aside based on the number of people served enter 10p; 
to indicate a 25% set aside based on total funds, enter 25f 

## Only include administrative services if they are NOT included in response to Question l-D. 
B What factors other than state or federal requirements influence your specific service mix? 
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iV, CHARACTERISTICS OF CLIENTS SERVED 
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A. Number of applicants in fiscal 199 



B. Number of clients served in fiscal 199 

1. Total clients served 

a) Number of clients that completed program 

b) Number of clients that dropped out of program " 

2. Number of clients served by more than one program during fiscal 199 

C. What was the distribution of clients served by this program in fiscal 199_ according to the following 
demographic categones? 





Include double counts 


Does the Law Specify a f^Aimmum 




Number 


Percent 


Level of Effort for This Group? 




of Clients 


of Clients 


What Level is Required? 


Population Group 


Sen/ed 


Sen/ed 


Yes* 


Level (%r* 


No 


Gender 












Male 












Female 












Age 












14-15 












16-21 












22-54 












55 and over 












Race/Ethniaty 












White (Non-Hispanic) 












Black (Non-Hispanic) 












Hisoanic 












Asian/Pacific Islander 1 










Native Amencan | 










Other (please specifv) i 










Low Income Status j 






\ 



* Enter "F" if a federal requirement: "S** if a state requirement. 

Indicate whether this requirement applies to the proportion of people receiving the service, or to the proportion 
of funds spent on it For example, to indicate a 10% set aside based on the number of people served enter lOp: to 
indicate a 25% set aside based on total funds, enter 25f. 



NOTtI: JTPA programs may substitute a printout showing annual data from the Quarteriy Report of 
Participant Characteristics and Activity Report of Enrollee Characteristics in lieu of completing questions 
IV'C and IV-E. 

D. What factors other than state or federal law influence the type of clients served*? 



IV- CLIENTS SERVED, CONTD 



E. Which of the following target groups were served by your program in fiscal 1 99 ? 





Include Double Counts 


Does the Law Specify a Minimum 
Level of Effort for This Group? 
What Level is Required? 




Number 
of Clients 
Served 


Percent 
of Clients 
Served 


Target Group 


Yes* 


Level (%r 


No 


At-Risk Youth (in-schoci) 












High School Dropouts 












High School Graduates 












Welfare Reaoients 












Public Housing Residents 












Unemployment Recipients 












Unemployment Exhaustees 












Not in Labor Force 












Older Worlcers (55+) 












Veterans 












Limited English Speaking 












Refugees/Immigrants 












Persons with Disabilities 












Offenders 












Other (please specify) 




























1 


















1 : 




1 





* Enter T'^ f a federal requirement. "S" if a state requirement. 

Indicate whether this requirement applies to the proportion of people receiving the service, or to the proportion 
of funds spent on it. For example, to indicate a 10% set aside based on the number of people served enter 1Cd: to 
indicate a 25% set aside based on total funds, enter 25f. 



NOTE: JTPA programs may substitute a printout showing annual data from the Quarterly Report of 
Participant Characteristics and Activity Report ofEnrollee Characteristics in lieu of completing 
questions A/-C and IV-E. 



F. What factors other than state or federal requirements influence the mix of clients served in fiscal 1993? 



WORKFORCE DEVELOPMENT PROGRAM SURVEY 
Instructions for Completing SDA Questionnaire 
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NOTE: Please answer all questions. Do not leave responses blank. Enter an em dash 
( — ) if response is not applicable. Enter NA if data is not available. 



1. Service Delivery Area. Enter the name of the Service Deliver}* .Axea. 

2. Name of Program. Enter the namo of the pr02:ram. 

3. Administering Agency. Enter the name of the state agency responsible for program 
administration. 

4. Contact Person. Enter the name and phone number of the person who can best answer 
follow -up (luestiuns regarding: the completion of this questionnaire. 

5. Fiscal Year Reported. Enter the last fiscal year for which you have complete data and base 
your responses on this year Enter the oe-^mning and endins: dates for the fiscal year reported. 

Part I. FUNDING LE\nELS AND DISTRIBUTION 

Thi> portion of the -ur\-p\ f<*^'u>cs on fundiniz levels and the distributinn i)f funds to recipients 
withm the -tate's fifteen Sep.- ice Delivery Areas 

A. Program Funds. Enter the total amount of funds awarded to the SDA under this proi^ram 

B. Funding Sources. Enter the amount of funds awarded to the SDA throu2:h this proi^ram 
lienved from federal. :>tate. and local £:overnments as well as proe:ram funds obtained from other 
sources. For <tate funds, please mdicate the state budget line item under which program funds 
were provided. 

C. Direct Services. Indicate how much of the program's fiscal 199 fundins: was retained by 

the SDA's Regional Employment Board to provide direct sen'ices. By direct serv^ices, we mean 
instances where the Regional Employment Board provides sendees to clients, such as the 
operation of a skills center. 

D. Non-Direct Services. Indicate how much of the program's fiscal 199 funding svas 

retained by the SDA's Regional Employment Board for non-direct service purposes, such as 
general administration, technical assistance, monitoring and oversight, etc. 

E. Funding Distributions. Of the balance of fiscal 1S9 funds not included in Items C and 

D. how much was all(x:ated by the SDAs Reo:ional Employment Board to recipients by allocation 
formula, by competitive requests for proposals, by non-competitive grants, or by some other 
allocation method. \otc: the amount reported in item A should equal the sum of the amounts 
reported in ifem.<; C, D, and E. 



F. Funds Distributed by Administering Agency. Indicate how much of this prosnram's 
funding for fiscal 199_ was distributed to direct recipient organizations in the SDA by the 
program's administering agency For each type of direct recipient, enter the total amount of 
funds received and the amount distributed by formula, by RFP. and by non-competitive grants. 

Part 11. SERVICE PROVIDERS 

A. Service Provider Organizations. This section of the survey asks for information on the 
tv-pes of service providers utilized under this program in this SD.A Indicate the total amount of 
funds awarded to each of the types of service providers listed in the table. In addition, please 
indicate whether or not the use of each t\'pe of service provider is required by federal and'or 
state statute 

B. Service Provider Mix. Bnefly descnbe w hat factors other than federal andbr state law 
influence the mix of service providers utilized under this program in this SD.A 

Part III. SERVICES 

A. Type of Services. This section of the survey asks for information on the t\-pes of services 
provided through this program in this SD.\ P'or each type of service, indicate the total amount 
of program funds and the number of cbonts served, including "double counts." In addition, tor 
each ser\-ire provided, please indicate whether federal anclor state law require a minimum lovrl 
of effort, and if so. note the minimum required service level Be sure to indicate whether the 
minimum -pr\ u'P threshold applies to the i)roportion of funds or to tne proportion uf clients 
<ervod 

B. Service Mix. BricilN df^srrihe what factor^ Dthor than fo<l(Tal and or >tato Lus iniluonro iho 
mix ' l'-pr\'HT'S pnAMtlcd und^r this proeram in this SOA 

Part IV. CHARACTERISTICS OF CLIENTS SER\TED 

Thi> -e<'tu)n i/f tho -urx py t^fx:u>os on the oharactoristirs (if clients >or\-nd undnr thi> proL^ram in 
this SDA 

A. Applicants. Kntcr the number of applicants for services under this proirram in this SPA 
fur fiscal 199_ Include all individuals who applied for assistance under this program 

B. Clients Served. Enter the total number of clients served under this program in this SDA in 
fiscal 199_ In addition, please list the number of clients that completed the program, the 
number of chents that dropped out of the program prior to completion, and the number of clients 
that were ser\*ed by more than one program over the course of the fiscal year. 

C. Client Characteristics. Report the number and percentage of chents sers-ed in fiscal 199_. 
according to the d(^mographic categories listed in the table. Include "double counts" )n vour 
calculations In addition, please indicate whether or not federal andL'or state law require a 
minimum level of effort regardini^ certain demographic groups. .\nd if so. please be sure to 
indicate w hether the minimum level of effort applies to the proportion of funds or to the 
proportion of clients serx'od. Sote: JTPA programs may substitute a printout shou ina annual 
data from the Quarterly Report of Participant Characteristics and Actuity Report of Enrollee 
Characteristics in lieu of completing questions IV -C and IV-E. 



D. Client Mix. Briefly describe what factors other than federal and/'or state law influence the 
tvpe of clients served under this program in this SD.-V 

E. Target Groups. Report the number and percentage of clients ser\'ed under this program in 

thi^i SDA in fiscal 199 according to the target groups listed in the table. Include Mouble 

counts" in your calculations. In addition, please mdicate whether or not federal and/or state law 
r'?quire a minimum level uf effort regarding certain target groups. .And if so. please be sure to 
indicate whether the minimum level of effort applies to the proportion of funds or to the 
proportion of clients ser\'cd. Sole: JTPA programs may substitute a printout shouing annual 
data from the Quarterly Report of Participant Characteristics and Activity Report of Enrollee 
CharacterL<;tics in lieu of completing questions IV -C and IV-E. 

F. Target Group Mix. BrieHy describG what factors other than federal and/or state law 
influence the t>-pe of client groups targeted for sor\'ices under this program in this SD.-V 



Part V. Geographic Service Distribution Within SDA 

A. Geographic Areas. Indicate the distribution of [)rogram funds among central cities, 
suburban cities, and rural n)mmunuio> within this SDA during fiscal 199 



WORKFORCE DEVELOPMENT PROGRAM SURVEY 
Service Delivery Areas 



PLEASE COMPLETE ONE SURVEY FOR EACH WORKFORCE DEVELOPMENT PROGRAM *** 



1 . Service Delivery Area: 

2. Name of Program: 



3. Administering State Agency: 

4. Contact Person: Phone: 

5. Fiscal Year Reported: Dates for Fiscal Year: From: To^^ 

I. FUNDING LEVELS AND DISTRIBUTION 



A. Total funds awarded to SDA through this program in fiscal 199 



B. How much of the funds available through this program in fiscal 199 were from the following sources: 

1. Federal $ 

2 State $ State Budget Line Item Number: 

3. Local S 

4. Other S (please specify) 



C. How much of this program's fiscal 199 funding was retained by the SDA to provide direct services (for 

example, occupational training, skills assessment, support ser\'ices. counseling, etc.)'? 

S Please describe services provided: 



D How much of this program's fiscal 199 funding was retanned by the SDA for non-direct service purposes. 

such as technical assistance, monitonng and oversight, general administration, etc.? 

S Please descnbe activities: 



Of the balance of funds that are not accounted for in questions and ''D" above, how much of this program's 
fiscal 199 funding was allocated to direct recipients and/or service providers in this SDA by 

$ 1. Program's administering agency 

^ ~ 2. Regional Employment Boards (SDA) 



NOTE: Amount reported in Item A should equal the sum of amounts reported in ttems C, D, A E. 
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F. How much of this program's funding in fiscal 199 was distributed by the program's administering agency to 

each of the following types of direct recipients in this SDA. Note that direct recipients may not necessarily be 
the ultimate service provider For example, municipal govemments may be the direct recipients of program 
funds, but they could then use them to fund community based organizations to provide services. 



Funds Distributed by Administering Agency 


Amount Distributed by 


Type of Direct Recipient 


Total Dollars 


Formula 


RFP 


Grant 


Municipal govemments 










Local school systems 










Higher education institutions 










Community based organizations 










Other (please specify) 





























































6-y 
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II. SERVICE PROVIDERS 
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A. What types of organizations in this SDA were the sen/ice providers for this program in fiscal 1 99 ? 



Complete as many responses as are applicable 


Total Dollar 
Amount Awarded 


Is Use of This 
Provider Required by 
Federal/State Statute 


Type of Sen/ice Provider 


Yes' 


No 


State Agency-Direct State Service Provision 








SDA Skill Center 








DET Opportunity Job Center 








Elementary and Secondary Schools 








Vocational School 








Proprietary School (Non-Degree Granting) 








Community College 








Two-Year Private College 








English-as-Second Language Learning Centers 








Community-Based Organizations 








Other (please specify) 

































































* Enter "F" if a federal requirement; "S" if a slate requirement. 



B. What factors other than state or federal law influence the mix of service providers for this program? 
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III. SERVICES 



A. What types of services were provided under this program in this SDA? 



Complete bs mBny items as 




Does f/ie Law Specify a Minimum 
Level of Effort for This Service? 
What Level is Required? 


QppliCQble for this program 


ft \Jyi Of 1 1 

Funds 


Served* 


Type of Service 


Yes* 


Level {%}** 


No 


Job Search Assistance 












Job Spflrrh 












Inh Planpmpnt 

OWL/ 1 lawdit^iii 
















































Ractc Skills 




































I itprflrv Trflinmn 












Arlilit Rfl<%ir Prltir_atinn 
















































Occupational Training 












Occupational training 












On-the-job training 












Quality/productivity training 












Other (please specify) 




































Administration## 

























# Include double counts, 

* Enter "F" if a federal requirement: "S" if a state requirement. 

** Indicate whether this requirement applies to the proportion of people receiving the service, or to the proportion 
of funds spent on it. For example, to indicate a 10% set aside based on the number of people served enter lOp: to 
indicate a 25% set aside based on total funds, enter 25f. 

## Only include administrative services if they are NOT included in response to Question l-D. 
B. What factors other than state or federal requirements influence the type of services provided under this program'? 
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IV. CHARACTERISTICS OF CLIENTS SERVED 
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A. Number of applicants in fiscal 1 99 

B. Number of clients served in fiscal 1 99 

1 . Total clients served 

a) Number of clients that completed program 

b) Number of clients that dropped out of program 

2. Number of clients served by more than one program during fiscal 199 

C. What was the distribution of clients served by this program in fiscal 199 according to the following 

demographic categories? 





Include double counts 


Does the Law Specify a Minimum 




Number 


Percent 


Level of Effort for This Service? 




of Clients 


of Clients 


What Level is Required? 


Population Group 


Served 


Ser/ed 


Yes* 


Level (%r* 


No 


Gender 












Male 












Female 












Age 












14-15 












16-21 












22-54 












55 and over 












Race/Ethniaty 












White (Non-Hispanic) 












Black (Non-Hispanic) 












Hispanic 












Asian/Pacific Islanaer 


\ 










Native Amencan 












Other (please specify) 


1 








Low Income Status 













* Enter "F" if a federal requirement; "S" if a state requirement. 

Indicate whether this requirement applies to the proportion of people receiving the service, or to the proportion 
of funds spent on it. For example, to indicate a 10% set aside based on the number of people sen/ed enter lOp; to 
indicate a 25% set aside based on total funds, enter 25f. 

NOTE: JTPA programs may substitute a printout showing annual data from the Quarterly Report of 
Participant Characteristics and the Activity Report ofEnroilee Characteristics in lieu of completing 
questions IV-C and fV-E, 



D. What factors other than state or federal requirements influence the type of clients sen/ed under this program? 
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IV. CLIENTS SERVED, CONTD 



E. Which of the following target groups were served by this program in fiscal 199 ? 





Include Double Counts 


Does the Law Specify a f^inimum 
Level of Effort for This Service? 
What Level is Required? 




Number 
of Clients 
Served 


Percent 
of Clients 
Served 


Target Group 


Yes" 


Level 


No 


At-Risk Youth (in-schoo() 












High School Dropouts 












High School Graduates 












Welfare Recipients 












Public Housing Residents 












Unemployment Recipients 












Unemployment Exhaustees 












Not in Labor Force 












Older Workers (55-^) 












Veterans 












Limited English Speaking 












Refugees/Immigrants 












Persons with Disabilities 












Offenders 












Other (please specify) 

















































* Enter "F" if a federal requirement: "S" if a state requirement. 

** Indicate whether this requirement applies to the proportion of people receiving the service, or to the proportion 
of funds spent on it. For example. lO indicate a 10% set aside based on the number of people served enter 10p to 
indicate a 25% set aside based on total funds, enter 25f. 

NOTE: JTPA programs may sut^stltute a printout showing annual data from the Quarterly Report of 
Participant Characteristics and Activity Report of Enrollee Characteristics in lieu of completing 
questions A/-C and IV-E, 

F. What factors other than state or federal requirements influence the target groups served in fiscal 199 



V. GEOGRAPHIC SERVICE DISTRIBUTION WITHIN SDA 



A. What was the total amount of funds m fiscal 199 distnbuted to service providers in this SDA in the following types 

of geographic areas? 

Central cities 

Suburban cities 

Rural areas ^ . 
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III. A PROTOCOL FOR CREATING A SURVEY EATABASE, 

tZ7 Instructions for computerizing survey questionnaires 

The following will give you some idea about setting up a database system for survey 

questionnaires. 

Special Notes :- 

(1) All the words in itnlics are defined later in Protocol Appendix. 

{2) This Document has many symbols. Symbols and meanings are as follows : 



Zl - Very important, must follow the instructions without fail. 



^A - Suggested approach, should follow it. This will enhance your database. 



2^ or JL - WARNING or BE AWARE. Never do this. This is a loophole. 

0 - Try to avoid this. This is not advisable. 

1 • - Remember. This is something that you should remember. This could be 

very useful, while designing or using a database. 
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To computerize Workforce or SDA survey questionnaires, you will need 

A computer - IBM/IBM Compatible Desktop, Apple Macintosh, IBM-Mainframe 

or any other computer system. 

A permanent storage system (Hard drive) 

A ivlalional database software program. 

If you want to use database specifically created foi "Survey-Questionnaire", you 
will need either 3.5" floppy drive or 5.25" floppy drive and any database software 

that is coniinUihlo with dBase software.. 

If you liave IBM/IBM Compatible computer and you want to use computerized 
survey database, Vou will need ALPIIA4'^" database software. To obtain this 

software, please contact your local softwai*e dealer^ 

ALPHA4"^" is 100% dBase"^^ compatible. dBase"^" file 

format is industry standard, hence any database program will read your data. 



A database is collection of many data points or fields. 



51 



Please look at the Workforce Program Survey Form. Look at the first page. In 
the first i)art we liave four Cjuestions. 

(Question 1: Name of Program : — 



l^Ufstion ± Achninisiuriug Agency : 

Question IV. Contact I^erson : Phone : 

Question 4: Fiscal Year Reported : 

Dates for Fiscal Year ; From To : 

(T) Question 1 has one jiart. 

(2) Question 2 has one [nul. 

(3) ()uestion I] has two jiarts. 

(4) (Question 4 has three j^arts. 

So this [)art of the ([uest ionnaire contains 7 answers/sub-answurs. 
We will need 7 fiekls in this database. 

flow to define fields and database - Stop by Stop procedure. 

PIt;ase k^ok at exhibit 1 and 2. Methodology is as follows : 

o 

- Ask quest ion; sub-question 
O - ('»ot the answiM' 

O - C'heck, if the answer is (a) - Text 

(b) - Numbers 

(c) - Logic 
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O - If the answer is "text", using your best judgement guess how long the 

maximum answer could be A - Remember space is also a character. If 

the (luestion is about program name, you can allocate about 70 
characters. 

^ - We strongly recom.mend you to allocate length between 60 and 70. 

If your length is less then 70, then it will be easy to view title (question) 
and answer both on same line. Normal computers can show 80 characters 
on any single line. So when you design your database vicw-scvccn, you can 
rcpUcate the actual form on screen, 
(b) If the answer is "Numeric", i.e. numbers, once again guess the maximum 
length and decimal points. For percentages it will be ''\00,00\ For 
number of people served it could be ''1,234,567\ For dollar allocated in 
1992 it could be ''$987,674,32L00\ In the first case total length will be 6. 
It can be calculated as follows: 3 digits before decimal + 1 for 
the decimal point itself + 2 spaces after decimal point, totals 6. In the 
second case (1,234,567), length will be 7. Here we do not have decimal 
point, so we can just count the digits and allocate the space. In the third 

case we will need 12 digits (9+1+2). t'_/' - decimal point has to be 




added to toial length, but comma does not require a space. 

(c) If the answer is "Logic", i.e. 'TRUE' or TALSE\ Tlie computer interin*ets 
this as a one 'text' character. The only option you will have is 'T' for 
'True' and 'F' for false. Normally this type is seldom used in the type of 
work we are involved in, so we will not discuss it, 

(d) We do not use type "others". So we will not discuss it. 

By using instruction O , you can create as many fields as you want. The only 

limitation is imposed ])y datal)ase softwares. Normally most of the commonly 
used database sf)ftware have the following major limitations : 

(a) Length of 'text Hekr is limited to 254. 

(b) 'i'otal fields in (me file cannot exceed 128. 

(.e) Fieldnames can not have spaces & many other chai*acters. For example 
you can not name your field as "PROG NAME". It could be 
1MU)G_NAME". 

Using techniques mentioned above, you can create a file as well as fields. 

- We stiggost that for each question in a sm^vey questionnaire, create 

separate filr. 



EXHIBIT 2: WORKFORCE DEVELOPMENT 
PROGRAMS: COMPUTERIZED DATABASE 




i 



Question! Questionl ;Question| Question 
I I II I III I IV 
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- [3 - When y{)U are creating the second file, you MUST cuter one field, same 

as the first file. The first is also known as primary file. You must have at least 
one common field in all your files, so all database files can be combined. You can 
u.se field "Program^Name". Normally first field in every file should be 
"Pro(!;ram_Name". Figure 3 shows how they can be arranged. 
We have the following suggestions for defining and linking files : 

Q) - Do not use program name as a common field. (1) You will have to enter 

n long program name for each file. If you have 4 or 5 files, you will have 
to enter a very long string 4 to 5 times, (2) You are likely to make a 
mistake, when you do so. Even if you put e.xtra space or forget one, your 
files will not be linked and your database W'ill not set up properly. 

y/^ ' We suggest that you create one numeric field and name it as "FORM_ID". 

Suggested length is 3. Each file should have "FORM J as a first field. 
Hy using this you only have to enter 3 digits each time. Many softwares 
automat-ically absign a new number for you. 

^/' " Yon want to keep your filenames simple and meaningful. The file which 
contains information about first question, can be named "QUEST 1". 



Also do not forget to index your files. Indexing will increase your speed 

and your data will be more organized. Database soflvvare will have an 
option about indexing. 
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IVotocol Appendix 



Dal abuse i.inkiim 



Joining two database files via some common field. Computer 
looks for two common data (numbers or text). If il finds a match, 
il will combine those two files. 



Dutiibiisc 



A structure, under which many fields or data cntiy can be 
linked. Difference between Relational database and Database 
is that the former links more than one of the later types. If we 
have two databases, we can relate them to have a relational 
database. 



It is a sub-member of database. A database consists of many 
fields, liach field answers one jiarticular cjuestioii. In comjuiter 
language, four major types of field exists. (1) Character, (2) 
Numeric, (3) lx)gic and (4) Memo. The fourth type is not 
commonly used. 



Index 



Data is sorted by some field. It could be numeric field or 
character field. You can also use combination of fields. 



RcL'ilioiuil Dalahusc - 



A software program that connects two ov more data fields or 
ckita files. It uses some sort of common reference, which logically 
relates files or fields. 



Scfix^fi'Vicw 



Ntost of the database softwares will let you create a screen 
design. Screen desii^n will let vou exhibit the data or fields in 
format that you specify. Most of the time it is used to duplicate 
the data-entry form on computer screen. 



59 

COiNCLUDING REMARKS 

In their sixteenth annual report (1991), the National Cornmission for Employment Policy 
states: "A major goal of federally-sponsored employment and training programs is to improve 
the match b. veen employers' demand for workers and the available supply of workers... For 
several reasons there is an ongoing need to ask how the scope of these employment anc training 
programs can be enhanced." (p. 27) A state-by-state survey of program objectives in relation to 
targeted groups would go a long way in addressing this need. The survey instrument presented 
in this report would provide disaggregated data as well as aggregated data on program 
objectives, funding, and targeted groups. Most of all, survey findings would help to answer the 
fundamental questions: Does the money go where the needs are? and How good is the match 
between the demand for and the supply of government training services? The MJC survey 
constituted a valuable first step in the right direction; other steps are needed to enhance this 
work. 



ERLC 



ENDNOTES 



60 



1. Separate responses were returned for the three BayState Skills Corporation component: 50/50; 
Global Education; and Displaced Homemakers, which are, therefore, counted as separate 
programs. The same holds true also for the Massachusetts Rehabilitation Commission (MRC) 
programs: Vocational Rehabilitation; Extended Employment; and Supported Employment; and 
for the Refugee Employment and Training Programs: Targeted Assistance: Allocation; Targeted 
Assistance: Discretionary; and Refugee Education and Employment, The School-to-Work 
Transition program(s?) is counted as one program even though two questionnaires were returned 
with in part conflicting responses. 

2. No information was given for DVOP, LVERS, TJTC, Refugee Education and Employment, 
Adult Education, and the programs offered by the Department of Mental Health (DMH). The 
Employment Services program indicated that 10 percent of its funds were allocated via RFP, yet 
no information was given for the remaining 90 percent of its funds. 

3. Educational institutions include local school systems, vocational schools, proprietary schools, 
community colleges, and private colleges. 

4. These are funds that the SDAs use for direct service provision (SDA Skills Centers), not 
those passed on by the SDAs to other ultimate service providers. 

5. The percentage distributions for the Basic Education (State and Federal) programs were also 
given but data on total program funding were missing. School -to-Work Transition (ID# 29) 
reported on total funding but identified local service providers for only 10 percent of those 
funds; the opposite is true for School-to-Work Transition (ID# 28): 100 percent of an unknown 
total dollar figure are reportedly receiv-^i by CBOs. For the Industrial Services Program (JTPA 
III), two sets of figures were submitted: one pertaining to "vendors" and a second one indicating 
fund allocation to "operators" who contract out to vendors. Since the conceot of "vendor" seems 
to correspond more closely to that of "local service provider", the discussion following in the 
text is based on the distribution of ISP funds to "vendors". 

6. Figures on program enrollees are taken from the March 1992 MJC Report ''Creating A 
Worlcl-Class Development System in Massachusetts'' smce the MJC Survey elicited information 
on people served only in terms of percentages of an unJefined total, never in absolute figures. 
Note that program titles in the MJC Report may differ from those in the MJC Survey returns. 
The MJC Survey, for instance, distinguished between three BayState Skills Corporation 
components: 50/50; Global Education; and Displaced Homemakers. Similariy, the MRC and 
Refugee Employment programs seem to have three components each. The MJC Report, 
however, lists only one figure for total program enrollees in each case. 

7. Programs were excluded when there was a less than perfect match between program 
title/description given in the MJC Survey returns and that given in the March 1992 MJC Report. 
For instance, the MJC Report lists 620 enrollees for the BayState Skills Corporation program 
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without indicating the distribution over the three components: 50/50, Global Education, and 
Displaced Homemakers. Consequently, the BayState Skills prograni(s) was not included in the 
analysis. 
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MJC SURVEY DATA BASE 



Table Set A: 
Table Set B: 

Table Set C: 

Table Set D: 

Table Set E: 

Table Set F: 



Funding Sources for Workforce Development Programs 

Methods of Funding Distribution for Workforce 
Development Pi'ograms 

Major Service Providers for Workforce Development 
Programs 

Types of Services Provided by Workforce Development 
Programs 

People Served by Workforce Development Programs 
(Socio-Economic Characteristics) 

Characteristics of Indiwduais Being Served by 
Workforce Development Programs (Demographic Ch.) 



TABLE SET A 
Funding Sources for Workforce Development Programs 
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TABLE SET B 
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